Correlation attack

In cryptography, correlation attacks are a class of known plaintext attacks for breaking stream ciphers whose keystream is generated by combining the output of several linear feedback shift registers (called LFSRs for the rest of this article) using a Boolean function. Correlation attacks exploit a statistical weakness that arises from a poor choice of the Boolean function – it is possible to select a function which avoids correlation attacks, so this type of cipher is not inherently insecure. It is simply essential to consider susceptibility to correlation attacks when designing stream ciphers of this type.

1 Explanation
2 Example
- 2.1 Breaking the Geffe generator
- 2.2 Clarifying the statistical nature of the attack
3 Higher order correlations
- 3.1 Definition
- 3.2 Terminology
4 Cipher design implications
5 See also
6 References
7 External links

Explanation

Correlation attacks are possible when there is a significant correlation between the output state of one individual LFSR in the keystream generator and the output of the Boolean function that combines the output state of all of the LFSRs. Combined with partial knowledge of the keystream (which is easily derived from partial knowledge of the plaintext, as the two are simply XORed together), this allows an attacker to brute-force the key for that individual LFSR and the rest of the system separately. For instance, if, in a keystream generator in which four 8-bit LFSRs are combined to produce the keystream, and one of the registers is correlated to the Boolean function output, we may brute force it first and then the remaining three, for a total attack complexity of 2⁸ + 2²⁴. Compared to the cost of launching a brute force attack on the entire system, with complexity 2³², this represents an attack effort saving factor of 255, which is substantial. If a second register is correlated with the function, we may repeat this process and drop the attack complexity to 2⁸ + 2⁸ + 2¹⁶ for an effort saving factor of 65027. In this sense, correlation attacks can be considered divide and conquer algorithms.

Example

Breaking the Geffe generator

Correlation attacks are perhaps best explained via example. We will consider the case of the so-called Geffe keystream generator. The Geffe generator consists of three LFSRs: LFSR-1, LFSR-2 and LFSR-3. If we denote the outputs of these registers by $x_1$ , $x_2$ and $x_3$ , respectively, then the Boolean function that combines the three registers to provide the generator output is given by $F(x_1, x_2, x_3) = (x_1 \wedge x_2) \oplus (\neg x_1 \wedge x_3)$ (i.e. ( $x_1$ AND $x_2$ ) XOR (NOT $x_1$ AND $x_3$ )). There are 2³ = 8 possible values for the outputs of the three registers, and the value of this combining function for each of them is show in the table below:

Boolean function output table
$x_1$	$x_2$	$x_3$	$F(x_1, x_2, x_3)$
0	0	0	0
0	0	1	1
0	1	0	0
0	1	1	1
1	0	0	0
1	0	1	0
1	1	0	1
1	1	1	1

Let us consider the output of the third register, $x_3$ . The table above makes it clear that of the 8 possible outputs of $x_3$ . 6 of them are equal to the corresponding value of the generator output, $F(x_1,x_2,x_3)$ , i.e. $x_3 = F(x_1,x_2,x_3)$ in 75% of all possible cases. Thus we say that LFSR-3 is correlated with the generator. This is a weakness we may exploit as follows:

Suppose we intercept the ciphertext $c_1, c_2, c_3, \ldots, c_n$ of a plaintext $p_1, p_2, p_3, \ldots$ which has been encrypted by a stream cipher using a Geffe generator as its keystream generator, i.e. $c_i = p_i \oplus F(x_{1i}, x_{2i}, x_{3i})$ for $i = 1, 2, 3, \ldots, n$ , where $x_{1i}$ is the output of LFSR-1 at time $i$ , etc. Suppose further that we know some part of the plaintext, e.g. we know $p_1, p_2, p_3, \ldots, p_{32}$ , the first 32 bits of the plaintext (corresponding to 4 ASCII characters of text). This is not as improbable as it may seem: if we know the plaintext is a valid XML file, for instance, we know that the first 4 ASCII characters must be "<xml". Similar to this, many file formats or network protocols have standard headers or footers which can be guessed easily. Given the intercepted $c_1, c_2, c_3, \ldots, c_{32}$ and our know/guessed $p_1, p_2, p_3, \ldots, p_{32}$ , we may easily find $F(x_{1i}, x_{2i}, x_{3i})$ for $i = 1, 2, 3, \ldots, 32$ by XORing the two together. We now know 32 consecutive bits of the generator output.

Now we may begin a brute force search of the space of possible keys (initial values) for LFSR-3 (assuming we know the tapped bits of LFSR-3, an assumption which is in line with Kerckhoffs' principle). For any given key in the keyspace, we may quickly generate the first 32 bits of LFSR-3's output and compare these to our recovered 32 bits of the entire generator's output. Because we have established earlier that there is a 75% correlation between the output of LFSR-3 and the generator, we know that if we have correctly guessed the key for LFSR-3, approximately 24 of the first 32 bits of LFSR-3 output will match up with the corresponding bits of generator output. If we have guessed incorrectly, we should expect roughly half, or 16, of the first 32 bits of these two sequences to match. Thus we may recover the key for LFSR-3 independently of the keys of LFSR-1 and LFSR-2. At this stage we have reduced the problem of brute forcing a system of 3 LFSRs to the problem of brute forcing a single LFSR and then a system of 2 LFSRs. The amount of effort saved here depends on the length of the LFSRs. For realistic values, it is a very substantial saving and can make brute force attacks very practical.

We do not need to stop here. Observe in the table above that $x_2$ also agrees with the generator output 6 times out of 8, again a correlation of 75% correlation between $x_3$ and the generator output. We may begin a brute force attack against LFSR-2 independently of the keys of LFSR-1 and LFSR-3, leaving only LFSR-1 unbroken. Thus, we are able to break the Geffe generator with as much effort as required to brute force 3 entirely independent LFSRs, meaning that the Geffe generator is a very weak generator and should never be used to generate stream cipher keystreams.

Note from the table above that $x_1$ agrees with the generator output 4 times out of 8 - a 50% correlation. We cannot use this to brute force LFSR-1 independently of the others: the correct key will yield output which agrees with the generator output 50% of the time, but on average so will an incorrect key. This represents the ideal situation from a security perspective - the combining function $F(x_1,x_2,x_3)$ should be chosen so that the correlation between each variable and the combining function's output is as close as possible to 50%. In practice it may be difficult to find a function which achieves this without sacrificing other design criteria, e.g. period length, so a compromise may be necessary.

Clarifying the statistical nature of the attack

While the above example illustrates well the relatively simple concepts behind correlation attacks, it perhaps simplifies the explanation of precisely how the brute forcing of individual LFSRs proceeds. We make the statement that incorrectly guessed keys will generate LFSR output which agrees with the generator output roughly 50% of the time, because given two random bit sequences of a given length, the probability of agreement between the sequences at any particular bit is 0.5. However, specific individual incorrect keys may well generate LFSR output which agrees with the generator output more or less often than exactly 50% of the time. This is particularly salient in the case of LFSRs whose correlation with the generator is not especially strong; for small enough correlations it is certainly not outside the realm of possibility that an incorrectly guessed key will also lead to LFSR output that agrees with the desired number of bits of the generator output. Thus we may not be able to find the key for that LFSR uniquely and with certainty. We may instead find a number of possible keys, although this is still a significant breach of the cipher's security. If we had, say, a megabyte of known plaintext, the situation would be substantially different. An incorrect key may generate LFSR output that agrees with more than 512 kilobytes of the generator output, but not likely to generate output that agrees with as much as 768 kilobytes of the generator output like a correctly guessed key would. As a rule, the weaker the correlation between an individual register and the generator output, the more known plaintext is required to find that register's key with a high degree of confidence. Readers with a background in probability theory should be able to see easily how to formalise this argument and obtain estimates of the length of known plaintext required for a given correlation using the binomial distribution.

Higher order correlations

Definition

The correlations which were exploited in the example attack on the Geffe generator are examples of what are called first order correlations: they are correlations between the value of the generator output and an individual LFSR. It is possible to define higher order correlations in addition to these. For instance, it may be possible that while a given Boolean function has no strong correlations with any of the individual registers it combines, a significant correlation may exist between some Boolean function of two of the registers, e.g. $x_1 \oplus x_2$ . This would be an example of a second order correlation. We can define third order correlations and so on in the obvious way.

Higher order correlation attacks can be more powerful than single order correlation attacks, however this effect is subject to a "law of limiting returns". The table below shows a measure of the computational cost for various attacks on a keystream generator consisting of eight 8-bit LFSRs combined by a single Boolean function. Understanding the calculation of cost is relatively straightforward: the leftmost term of the sum represents the size of the keyspace for the correlated generators, and the rightmost term represents the size of the keyspace for the remaining generators.

Generator attack effort
Attack	Effort (size of keyspace)
Brute force	$2^{8 \times 8} = 18446744073709551616$
Single 1st order correlation attack	$2^8 %2B 2^{7 \times 8} = 72057594037928192$
Single 2nd order correlation attack	$2^{2 \times 8} %2B 2^{6 \times 8} = 281474976776192$
Single 3rd order correlation attack	$2^{3 \times 8} %2B 2^{5 \times 8} = 1099528404992$
Single 4th order correlation attack	$2^{4 \times 8} %2B 2^{4 \times 8} = 8589934592$
Single 5th order correlation attack	$2^{5 \times 8} %2B 2^{3 \times 8} = 1099528404992$
Single 6th order correlation attack	$2^{6 \times 8} %2B 2^{2 \times 8} = 281474976776192$
Single 7th order correlation attack	$2^{7 \times 8} %2B 2^{8} = 72057594037928192$

While higher order correlations lead to more powerful attacks, they are also more difficult to find, as the space of available Boolean functions to correlate against the generator output increases as the number of arguments to the function does.

Terminology

A Boolean function $F(x_1, \ldots, x_n)$ of n variables is said to be "m-th order correlation immune" or to have "m-th order correlation immunity" for some integer m if no significant correlation exists between the function's output and any Boolean function of m of its inputs. For example, a Boolean function which has no first order or second order correlations but which does have a third order correlation exhibits 2nd order correlation immunity. Obviously, higher correlation immunity makes a function more suitable for use in a keystream generator (although this is not the only thing which needs to be considered).

Siegenthaler showed that the correlation immunity m of a Boolean function of algebraic degree d of n variables satisfies m + d ≤ n; for a given set of input variables, this means that a high algebraic degree will restrict the maximum possible correlation immunity. Furthermore, if the function is balanced then m + d ≤ n − 1.^[1]

It follows that it is impossible for a function of n variables to be n-th order correlation immune. This also follows from the fact that any such function can be written using a Reed-Muller basis as a combination of XORs of the input functions.

Cipher design implications

Given the possibly extreme severity of a correlation attack's impact on a stream cipher's security, it should be considered essential to test a candidate Boolean combination function for correlation immunity before deciding to use it in a stream cipher. However, it is important to note that high correlation immunity is a necessary but not sufficient condition for a Boolean function to be appropriate for use in a keystream generator. There are other issues to consider, e.g. whether or not the function is balanced - whether it outputs as many or roughly as many 1's as it does 0's when all possible inputs are considered.

Research has been conducted into methods for easily generating Boolean functions of a given size which are guaranteed to have at least some particular order of correlation immunity. This research has uncovered links between correlation immune Boolean functions and error correcting codes^[2].

References

Bruce Schneier. Applied Cryptography: Protocols, Algorithms and Source Code in C, Second Edition. Jon Wiley & Cons, Inc. 1996. ISBN 0-471-12845-7. Page 382 of section 16.4: Stream Ciphers Using LFSRs.

^ T. Siegenthaler (September 1984). "Correlation-Immunity of Nonlinear Combining Functions for Cryptographic Applications". IEEE Transactions on Information Theory 30 (5): 776–780. doi:10.1109/TIT.1984.1056949.
^ Chuan-Kun Wu and Ed Dawson, Construction of Correlation Immune Boolean Functions, ICICS97

External links

The Online Database of Boolean Functions allows visitors to search a database of Boolean factors in several ways, including by correlation immunity.

Block ciphers (security summary)

Common algorithms	AES · Blowfish · DES · Triple DES · Serpent · Twofish

Less common algorithms	Camellia · CAST-128 · IDEA · RC2 · RC5 · SEED · Skipjack · TEA · XTEA

Other algorithms	3-Way · ABC · Akelarre · Anubis · ARIA · BaseKing · BassOmatic · BATON · BEAR and LION · CAST-256 · CIKS-1 · CIPHERUNICORN-A · CIPHERUNICORN-E · CLEFIA · CMEA · Cobra · COCONUT98 · Crab · Cryptomeria/C2 · CRYPTON · CS-Cipher · DEAL · DES-X · DFC · E2 · FEAL · FEA-M · FROG · G-DES · GOST · Grand Cru · Hasty Pudding cipher · Hierocrypt · ICE · IDEA NXT · Intel Cascade Cipher · Iraqi · KASUMI · KeeLoq · KHAZAD · Khufu and Khafre · KN-Cipher · Ladder-DES · Libelle · LOKI97 · LOKI89/91 · Lucifer · M6 · M8 · MacGuffin · Madryga · MAGENTA · MARS · Mercy · MESH · MISTY1 · MMB · MULTI2 · MultiSwap · New Data Seal · NewDES · Nimbus · NOEKEON · NUSH · Q · RC6 · REDOC · Red Pike · S-1 · SAFER · SAVILLE · SC2000 · SHACAL · SHARK · SMS4 · Spectr-H64 · Square · SXAL/MBAL · Threefish · Treyfer · UES · Xenon · xmx · XXTEA · Zodiac

Design	Feistel network · Key schedule · Product cipher · S-box · P-box · SPN

Attack (cryptanalysis)	Brute force · Linear · Differential (Impossible · Truncated) · Integral · Boomerang · Mod n · Related-key · Slide · Rotational · Timing · XSL

Standardization	AES process · CRYPTREC · NESSIE

Misc	Avalanche effect · Block size · Initialization vector · Key size · Modes of operation · Padding · Piling-up lemma · Weak key · EFF DES cracker · Key whitening

Cryptographic hash functions and message authentication codes (MACs)

Common functions	MD5 · SHA-1 · SHA-2

Functions	FSB · SHA-3 · ECOH · GOST · HAS-160 · HAVAL · LM hash · MDC-2 · MD2 · MD4 · N-Hash · RadioGatún · RIPEMD · Snefru · SWIFFT · Tiger · VSH · WHIRLPOOL · crypt(3) (DES)

SHA-3 finalists	BLAKE · Grøstl · JH · Keccak · Skein

MAC algorithms	DAA · CBC-MAC · HMAC · OMAC/CMAC · PMAC · VMAC · UMAC · Poly1305-AES

Authenticated encryption modes	CCM · CWC · EAX · GCM · IAPM · OCB

Attacks	Collision attack · Preimage attack · Birthday attack · Brute force attack · Rainbow table · Distinguishing attack · Side-channel attack

Misc.	Avalanche effect · Hash collision · Merkle–Damgård construction · Salt

Standardization	CRYPTREC · NESSIE · NIST hash function competition

Stream ciphers

Widely used ciphers: RC4 · Block ciphers in stream mode eSTREAM Portfolio: Software: HC-256 · Rabbit · Salsa20/12 · SOSEMANUK Hardware: Grain · MICKEY · Trivium

Other ciphers: A5/1 · A5/2 · E0 · FISH · ISAAC · MUGI · Panama · Phelix · Pike · Py · QUAD · Scream · SEAL · SNOW · SOBER · SOBER-128 · VEST · WAKE

Theory: Shift register · LFSR · NLFSR · Shrinking generator · T-function · IV

Attacks: Correlation attack · Correlation immunity

Cryptography

History of cryptography · Cryptanalysis · Cryptography portal · Outline of cryptography

Symmetric-key algorithm · Block cipher · Stream cipher · Public-key cryptography · Cryptographic hash function · Message authentication code · Random numbers · Steganography